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^ ' Abstract 

Q^ ' In the paper with the above title, D. T. Gillespie [Phys. Rev. A 49, 1607, 

(1994)] claims that the theory of Markov stochastic processes cannot provide 
Qh! an adequate mathematical framework for quantum mechanics. In conjunc- 

■y ' tion with the specific quantum dynamics considered there, we give a general 

analysis of the associated dichotomic jump processes. 

If we assume that Gillespie's "measurement probabilities" are the transition 
probabilities of a stochastic process, then the process must have an invari- 
ant (time independent) probability measure. Alternatively, if we demand the 
probability measure of the process to follow the quantally implemented (via 
the Born statistical postulate) evolution, then we arrive at the jump process 
which can be interpreted as a Markov process if restricted to a suitable du- 
ration time. However, there is no corresponding Markov process consistent 
with the Z2 event space assumption, if we require its existence for all times 
t E R+. 

Before, [|IJ , we have contested the general statement due to Gillespie M about the 
generic contradiction between the probabilistic concepts appropriate for quantum 
theory and those proper to the common-sense theory of stochastic (in particular, 
Markov) processes. Our argument was based on invoking the standard, configuration 
space, Schrodinger picture quantum dynamics which, if combined with the Born 
statistical interpretation postulate, allows for a consistent description in terms of 
Markov processes of diffusion type. In conformity with the rich theory developed so 
far, |, |, |, |, I . 
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However, our arguments did not pertain to stochastic jump processes which were 
the main objective of Ref. @. Let us therefore consider a simple two-level quantum 
system undergoing the Schrodinger evolution: 

ip{t) = exp(-ict) cos ujt |1 > — % exp(-ict) sinut |2 > (1) 

and concentrate on its probabilistic analysis, with an additional motivation coming 
from the series of papers due to other authors [[LCj, [11], [L2|, [13], [TJ], [T5| , where the 
Markov property has been attributed to analogous dynamical problems, see however 
Ref.||16||. We shall slightly simplify (1) by rescaling the dimensional constants to 
achieve lo — 1. 

The discussion of Ref. 0] departs from the following epistemological input: "If 
the system is known to be in state 1 at time s, then the probabilities of finding the 
system at any time t > s to be in states 1 and 2 are cos 2 (t — s) and sin 2 (t — s) 
respectively, and similarly that if the system is known to be in state 2 at time s 
then the probabilities of finding the system at any time t > s to be in states 2 and 
1 are cos 2 (t — s) and sin 2 (t — s) respectively". These "measurement probabilities" 
are then utilised as transition probabilities of a certain (presumed to be consistently 
defined) stochastic jump process, with the outcome that the quantum mechanical 
evolution is at variance with the canonical form of the master equation appropriate 
for the problem (Eqs. (13) in Ref. M). 

The above transition probabilities constitute a two by two transition matrix 
p G (t,s) with elements: 

p^(t,s) = cos 2 {t-s) =pg(t,s) (2) 

pf 2 (t, s) = sin 2 (t -s)= p 21 {t, s) 

To avoid any possible confusion, let us recall (see e.g. Ref. [|17]]) that a stochastic 
process on Z2, if considered on a finite time interval, say [0, T], is to be given 
by a hierarchy of transition probabilities (they are an easy transcription of those 
conventionally utilized in the framework of continuous processes): 

p(a,t) , < t < T (3) 

p(ai,ti\a 2 ,h) , < t 2 < h < T 

p(cr 1 ,t 1 \a 2 ,t 2 ,a 3 ,t 3 ) , < t 3 < t 2 < t x < T 

and so on, where each index a equals either 1 or 2. 

In the above, p(c,t) = fi{u 6 Q : X t {ui) = o}, o = 1,2 defines a probability 
measure of the stochastic process on Z 2 i.e. probabilities with which the dichotomic 
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random variable takes values along conrete sample (jumping) paths in the event 
space Q. The probability measure of the process is then propagated (or left invariant) 
by the transition probability t%\a 2 , t 2 ). 

The probabilities (3) have to satisfy the so called consistency conditions: 

(i) E„p(v,t) = l 

(ii) E CT1 p(0"i,*ik2,*2) = 1 and E CT2 p{<?u ti\a 2 , t 2 )p(a 2 , h) = p(cr 1 ,ti) 
(hi) T l a 1 p(^i,t 1 \a 2 ,t 2 ,a 3 ,t 3 ) = 1 

£ CT2 p(<ri, ti I (7 2 , t 2 , 0-3, t 3 )p(a 2 , t 2 \a 3 , t 3 ) = p(«7i,ti|<7 3 , t 3 ), 

E<x 3 p(o"i, fika, t 2> 0-3, t 3 )p(a 2 , t 2 \a 3 , t 3 )p(a 3} t 3 ) = p(a u t x \a 2 , t 2 )p(a 2} t 2 ) 

etc. 

For a Markov process we would have p(cri, ti\a 2 , t 2 , cr 3 , t 3 ) = p(cri,ti\a 2 ,t 2 ) in 
which case (iii) would reduce to a single identity 

^p{(yi,ti\a 2 ,t 2 )p(a 2 ,t 2 \a 3 ,t 3 ) = p{a u h\a 3 , t 3 ) (4) 

i.e. the Chapman-Kolmogorov equation. Then, the hierarchy is closed and the pro- 
cess is completely specified by giving its initial probability measure and its transition 
probabilities. 

Let us point out that in Ref. H the random dynamics was characterised ex- 
clusively in terms of transition probabilities and with no reference to a probability 
measure of the process. The probabilistic description of random jumps on Z 2 pat- 
terned after ]TU| , |TT| is given in terms of the " probability vector" (probability measure 



in the present case): 



*o - ( 23 ) (5) 



Pl(t)>0, P2(*)>0, Pl (t) + p 2 (t) = 1 

and the transition probability 



Pij(h,t 2 ) =p(i,tx\j,t 2 ) , i,j = 1,2 
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Pij{ti,t 2 ) > o , ^2p i j(t 1 ,t 2 ) = i 



£)Pij(*l,*2)Pi(*2) = Pi(*l) 



The last identity is equivalent to ^2)^(^2) = p(£i)> understood as the matrix- 
vector operation in the linear space. 

If Gillespie's transition matrix p G (t,s), (2), is to define a consistent stochastic 
process, in view of its breaking the Chapman- Kolmogorov identity, the higher rank 
conditional probabilities need to be introduced. Unfortunately, they are not given 



Nevertheless, let us take for granted that this supplementary step can be made 
so that p G (t,s) is a transition matrix of a well defined (nonMarkovian) stochastic 
process X t with values in Z 2 . It is natural to ask for the probability measure \x of 
this process i. e. for its probability vector pit). It must satisfy the consistency (in 
fact, propagation) condition 



inRef. @. 



p°(t, s)p(s)=p(t) 



(7) 



for all s < t. Let us analyze the issue in some detail. 

If p(0) is an arbitrary initial density, we can always write 




(8) 



with a G [0, 1]. Then, for all s > we have: 





and for every t > s 




(10) 



On the other hand, there holds: 



pit) =p G it,s)pis) 



(11) 



cos 2 (t — s)[acos 2 s + (1 — a)sin 2 s] + sin 2 it — s)[asin 2 s + (1 
sin 2 it — s)[acos 2 s + (1 — a)sin 2 s] + cos 2 (t — s)[asin 2 s + (1 



a)cos 2 s] 
a)cos 2 s] 
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Since (10) and (11) must be equal, we get the identity: 



(a 



-)sin2 
2 J 



s)sin2s = 



(12) 



to be valid for all < s < t. It implies a 



| and consequently 



(13) 



is the only admissible initial choice of p(0). 

Moreover, p G (t, s) is a symmetric matrix, which implies the following important 
property: if for some to we deal with p(a, to) = const which is independent of 
a = l,2, then for all t > t there is p(a, t) = p(a, t ) = const. This follows from the 
observation: 



CO 

As a consequence, by utilizing p G (t, s) as a transition probability appropriate for 
the stochastic process, we would arrive at the process, whose probability measure is 
conserved in time 



for all t > 0. 

The random dynamics induced by p G (t,s) is thus appropriate exclusively for 
systems with an invariant probability measure. It certainly has nothing in common 
with the quantally implemented evolution of the probability measure associated (via 
the Born postulate) with the explicit solution (1), i. e. with the probability vector 
pit) whose components read: p(l,t) = cos 2 t, p(2,t) = sin 2 {t). 

We believe, that a consistent approach towards a probabilistic reinterpretation 
of the quantum dynamics proper should result in the construction of a stochastic 
process (Markovian if possible) which is compatible with the quantum Schrodinger 
picture evolution (1). This issue has received attention in the literature, see e.g. 
Refs. 3-9 and Refs. 10-16 in particular. 

Let us follow this, alternative with respect to the reasoning of Ref. @, idea and 
demonstrate that the restriction to symmetric transition matrices (Gillespie's case, 
see e.g. Ref. (H| for more detailed discussion) implies that there is no consistent 



= XM^K^oMoo^o) = const ^2p(cr,t\<To,t ) 



(14) 




const /,p(cto, t\a, tp) = const 




(15) 
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Markov jump process which can be associated with the Schrodinger dynamics (1) 
for all times. 

Indeed, for the time dependent probability vector p(t), at time t = | we have 

m = ( & ) = (i6) 



sin (7r/4) 

and the previous result follows for times exceeding 7r/4. 

However, we can construct a Markov process running in the finite time interval 
[0,tt/4]. 

/ cos 2 t \ 

We have p(t) = . 2 1 . Let us define p(t,s): 

cos 2 t — sin 2 s 

2W, s) = p 2 2{t, s) = (17) 

cos 2 s 

cos 2 s — cos 2 t 

P\2it, s) = p-2i(t, s) = 1 - pn{t, s) = 

cos 2 s 

where < s < t < j. All these matrix coefficients are nonnegative in the time 
interval [0, ?]. Moreover, for 0<s<t<u<j, by inspection (with some help of 
trigonometric identities) we find the Chapman-Kolmogorov equation to be valid 

p(u,t)p(t,s) = p(u,s) (18) 

and so the Markov property is established. Obviously, the propagation formula 

P(M)( C °t ) = ( COS l) (19) 
v J y sin z s J \ smH ) v ' 

holds true. Also, we have limti s p{t, s) = I where I denotes the unit two-by-two 
matrix. It corresponds to the matrix element property p(i, s\j, s) = 5ij for all i, j = 
1,2. 

The major steps of our analysis, (3)-(19), did not rely on any "quantum measure- 
ment" epistemology and merely invoked mathematical features of stochastic jump 
processes on Z2. However, the main difference between the approach of Ref. || 
and this of Refs. [pi |TT] is rooted in the preferred choice of the connection be- 
tween mathematics and physics (here, pertaining to the concept of measurement in 
quantum theory). 

The theory of stochastic processes is normally regarded by physicists as a macro- 
scopic theory in the sense that one can probe the system without significantly per- 
turbing it. Then, it is not surprising that such a theory may be viewed Oas inconsis- 
tent with the ordinary quantum mechanics. This line of thought is followed in Ref. 
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On the other hand, instead of viewing the stochastic process as a description of 
one system evolving from t = — oo tot = +00, one might view it as a theory for 
an infinite ensemble of systems, all starting either in the same initial state or with 
some initial probability distribution over the possible states at time t = 0. The 
ensemble is allowed to evolve until we possibly decide to stop the systems. Viewed 
this way, the theory of stochastic processes might very well describe the evolution of 
a quantum system between measurements (compare e.g. in this connection the two 
time localization framework of Ref. ||19|| ). And that is the admissible interpretation 
of our previous discussion. In this case, on suitable time scales we have found the 
Markov property to persist. 

Let us stress that if the zero point of the time axis is taken to be the time of 
the measurement on the system, where the system was found to be in state 1, then 
there is no disagreement between our example (17)-(19) and the results of Ref. 0. 
The propagation from s = can be safely extended to an arbitrary time instant 
T > interpreted as a subsequent measurement of the system. However, to analyze 
the time evolution of the probability measure p(t) between those fixed time interval 
boundaries, we must define the transition probability p(t, s) for all intermediate time 
instants. Obviously, this corresponds to transitions between unobserved intermediate 
states and, as shows (18), for not too long time intervals of interest such stochastic 
interpolation is Markovian until interrupted (terminated) by the measurement. 
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